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Abstract —Neural gas (NG) is a robust vector quantization 
algorithm with a well-known mathematical model. According 
to this, the neural gas samples the underlying data distribution 
following a power law with a magnification exponent that depends 
on data dimensionality only. The effects of shape in the input 
data distribution, however, are not entirely covered by the NG 
model above, due to the technical difficulties involved. The 
experimental work described here shows that shape is indeed 
relevant in determining the overall NG behavior; in particular, 
some experiments reveal richer and complex behaviors induced 
by shape that cannot be explained by the power law alone. 
Although a more comprehensive analytical model remains to 
be defined, the evidence collected in these experiments suggests 
that the NG algorithm has an interesting potential for detecting 
complex shapes in noisy datasets. 

I. Introduction 

Neural Gas (NG) 11] is a robust algorithm for vector quan¬ 
tization with a well-known analytical model that has been first 
described in (20 and then expanded in other subsequent works 
0 0 According to this model, the Neural Gas algorithm 
performs a stochastic gradient descent over an energy function 
and converges to a final configuration whereby the density of 
NG units relates to the density of the underlying input data 
distribution via a power law that is usually called magnification 
(see e.g. (5)). Further studies have been conducted about the 
topographic mapping properties of the NG ||6j, namely the 
capability to represent an implicit neighborhood relation - 
which can be made explicit via Delaunay triangulation - that 
describes faithfully the topology of input data distributions. 
Other studies focused on NG variants that enable controlling 
the power law explicitly @> 0-0, in particular to obtain 
an exponent of value one that makes the two densities be the 
same, except for a scaling factor. 

The experimental study presented here is motivated by 
the objective of using NG for geometric inference and shape 
dejection , as it happens with the NG-related algorithm SOAM 
JTO) , that reconstructs a surface from a scattered point cloud 
of samples with topological and geometrical guarantees of 
faithfulness of the result obtained. For instance, this algorithm 
has been used for excluded volume computations in GD- More 
precisely, the focus of the study presented here is assessing 
the effects of shape in input data distributions over the NG 
behavior. For doing this, we consider input data distributions 
of the kind 

U (shape) * 7V(0, 0) 

According to Google Scholar, Q has 1291 citations. 


namely a uniform probability over a given shape convolved 
with some (isotropic) noise with specific parameters 0. 

Clearly, uniform shape sampling and isotropic noise are 
indeed limited representations of a real-world scenario for 
practical applications (e.g. for 2D or 3D image deconvolu¬ 
tion). Nevertheless, even within these limits, the experimental 
evidence collected reveals the substantial relevance of shape in 
determining the overall NG behavior and shows an interesting 
potential in this direction; as it will be discussed, while the 
relevance of power law is substantially confirmed, the effects 
of shape in data distributions can be even stronger in some 
circumstances and determine NG configurations that cannot 
be explained by the power law alone. 



(C) (d) 

Fig. 1. A point sample (a) drawn with (almost) uniform probability from the 
surface of the Stanford bunny is then convolved (b) with isotropic Gaussian 
noise. Presented with the latter and with appropriate parameter settings (see 
text), the Neural Gas (c) attains a final configuration from which the original 
surface can be reconstructed faithfully (d). 



In particular the focus of this work is providing an exper¬ 
imental assessment of NG behaviors like those exemplified in 
Fig. [I] while giving some preliminary explanations. Although 
a deeper study is required, i.e. for finding better analytical 
models describing the NG behavior in these cases, the evidence 
presented suggests that this study can be feasible and worth 
performing. 

II. Methods 

A. Neural Gas 


2) Relation with K-means: When A —>• 0, equation 0 
becomes equivalent to 

Aw, = 5 • Sn c( v ) • (v - wi), 

where k(v) is the function that returns the index of the closest 
neighbor in W to the input signal v. This is the update law of 
the well-known algorithm named K-means fl2| , (T3) , which 
performs an SGD over the distortion error 

Ek( w) = \ J v -P( v )( v - wfe( v) ) 2 c;v. 


Given an input data distribution described by probability 
P(v), where v G M D , a neural gas (NG) |2), jb] is a set W 
of k units , each associated to a reference vector in R D : 

W := {w*}, w i G i G {1,..., k}. 

The NG algorithm adapts progressively the reference vectors 
in W to the input probability P by repeating the following 
iteration: 

1) receive one signal v distributed as P(v); 

2) update the reference vectors in W (see below); 

3) return to step 1. 

In each iteration, the reference vectors in W are updated by 

Aw; = e ■ h\(ki(v))(v — Wj), (1) 

where fcj(v) := #{w j : ||v — Wj|| < ||v — Wj||} (# denotes 
the cardinality), e > 0 is a real parameter, 

ho(n) := £o n and h\(n) := e - ^, for A > 0 


3) Magnification: Considering the average position update 
of a unit with respect to P 


(Aw i)=e- [ P(v)ft A (fci(v))(v- w*)dv 
Jv 

under specific assumptions to be discussed below, in (2| it is 
also proven that: 


(Awi) oc 1 ~x f(d v P)(wi) 
P\Wi)c \ 


-P(Wi) 

a 


(<9 v p)(w^) \ 
p( w i) ) 


(4) 


where 


a := 


d 

dp 2’ 


p(wi) is the density of units in W at w i, d v p and <9 V P are the 
gradients with respect tovGk of, respectively, the density p 
and the probability P, and d is the dimension of the support 
V. The solution at equilibrium, i.e. when (Aw i) = 0, entails 
a power law: 

p(\Vi) oc P(wj) a . (5) 


(throughout this paper, S denotes the usual Kronecker delta 
function). 

1) Convergence: It is proven in 0 that the NG algorithm 
performs a stochastic gradient descent (SGD) over the energy 
function: 


In many related works (see for instance 0 0 0 G3) this 
particular power law is called magnification , while a is deemed 
the magnification factor. 

From a technical standpoint, the derivation of 0 relies on 
three main assumptions: 


-E’atg(W) = - 2 - y2 f p ( v )Mfci(v))(v - Wj) 2 dv (2) 

2Cx i= 1 

where V is the support of probability P(v) and 

k-1 

C x :=J2hx(i). 

i=0 

In particular, in (2'| it is proved that 

P = -kJ v 

which makes equation 0 an SGD update law. In keeping with 
this, an NG can be made to converge to a steady configuration 
by choosing values of e that decrease exponentially with the 
iterations of the algorithm: 

/ \ t/T 

e(i > :=£ <(f) • <3) 

where Si and Sf are the initial and final values, respectively, T 
is the total number of iterations and t is the current iteration. 


A.l: p is analytic in 

A.2: P is analytic in 

A.3: A > 0 and small with respect to the curvature of p 

and P. 

Assumption A.l means considering the discrete set W in the 
limit of a continuous density while A.2 is in often true ‘per se\ 
with typical input probabilities. Altogether, A.l and A.2 allow 
expanding p and P into Taylor series, whereas assumption 

A. 3 allows considering only the first terms in these. From 
another point of view, A.3 entails ‘flatness’ of P, at least in the 
scale of A, hence ruling out higher order contributions from 
its geometry. 

B. Numerical Experiments 

1) Estimating Probability and Density: The estimation of 
P(w^) and p(wi) is a crucial aspect for interpreting the results 
of numerical experiments and therefore requires an appropriate 
technique. In other works, like the ambient space is 

divided into bins of suitable size, while in |9| a Parzen window 
estimator is used. The estimation technique adopted here is 







described in |T6| . It is based on a weighted ^-distance defined 
in dD and that, in the discrete case, takes the form 


dc,m 0 (x) 



rn 0 


i=1 



( 6 ) 


where C is a finite point cloud in M D , mo E N + is a parameter, 
and c$(x) is the i-th nearest neighbor to x in C. In the case 
discussed here, C can either represent an empirical sample of 
points drawn from P or the set W of NG units. In CD it is 
shown that ([6} is distance-like, i.e. it shares many properties 
of a distance function, and that its level sets preserve the 
geometrical and topological properties of the corresponding 
level sets of the probability P from which the point cloud has 
been drawn. Based on 0, the estimator proposed in (l6| is 


F*C,mo ( x ) 


i ( ^ 

NV d 4 fmo (x )) 


(7) 


where N is the number of points in C and Vd is the volume 
of the D-dimensional unit ball. Reportedly, the estimator 0 
is optimal for 

mo — N D + 4 . 


In this work ([7]) has been used for estimating P(wi) and p(wi) 
respectively; the latter, in fact, can be normalized into the 
probability 

«<w<) =- 


For simplicity, however, in this work we will continue to refer 
to the unnormalized density p(w$). 


2) Entropy: Given a final NG configuration, the probability 
of a generic unit i of being 4 a winner’ in W, i.e. of being the 
nearest neighbor to a generic input signal v having probability 
P(v), can be estimated by 

Si 

Pi = — > 

5 

where s is the total number of input signals and Si is the 
number of input signals in the Voronoi cell of unit i or, in 
other words, is the number of input signals having Wi as their 
closest neighbor in W. 

The Shannon entropy function is defined as 

k 

H ~Ppi ln P»- ( 8 ) 

2=1 

The maximum of H is attained when all k units have equal 
probability of being the nearest neighbor of a random input 
signal sampled from P. In that case, the value of Shannon 
entropy is 

k 

H = — Y \ In y = — In \ = In k. 

^ k k k 

2=1 


3) Implementation and execution: The software for the 
experiments has been written in Java; all experiments have 
been performed with a 64-bit Java virtual machine running 
on an Intel® Xeon® CPU E-1240 v3 @ 3.40 GHz computer 
with 8GB of RAM. The Meshlab software tool fl8| has been 
used for 2D and 3D processing of point clouds and for the 
geometrical and topological validation of results. 


III. Results 

In the experiments decribed here, the initial positions of 
NG units in W have been randomly chosen with probability 
P. For this reason, the only parameters in 0 that determine 
the NG behaviour are e, A and k. 

In this study, the decaying law 0 has been adopted for 
parameter 6, with Si = 0.1 and Ef = 0.0001, to obtain 
steady NG configurations that make it easier the assessment 
of relevant properties. The combined effect of the remaining 
parameters A and k, with different input data distributions, has 
been studied in more than 3500 experiments, each intended as 
a complete run of the NG algorithm. 

Due to the general field of interest of this work, only 
2D and 3D ambient spaces have been considered. All input 
data distributions for the experiments were generated from 
probabilities in the general form of the convolution described: 

U(Shape)*N(O,0). 

Fundamental shapes like individual points, the unit circle S 1 , 
the unit disk ED, the unit sphere § 2 and the unit ball D(0,1) 
have been considered. As an example of a more complex 
shape, the Stanford bunn)0 which is a classical benchmark 
in the field of geometrical shape reconstruction, has been 
also adopted. For the noise model to be convolved, the class 
of multivariate normal distributions AE(0, XI) with isotropic 
covariance matrix, i.e. 

S := cr 2 1. (9) 

has been considered as the first option. 

Two other noise models have been considered. One is a 
sinusoidal probability with density 

JV(v;0,r):=|sm(| + |J!^!!) (10) 

whenever ||v — 0|| < r and 0 elsewhere in Another is the 
uniform density over a ball of given radius r: 

Z7(D(0,r)). 

To ensure the possibility of estimating probability densities at 
the points attained by NG units in the final configurations, 
all data distributions were generated in advance, as standalone 
point clouds, and then presented to the NG algorithm. 

For reasons of space and readability, in the rest of this sec¬ 
tion, the results obtained will not be described systematically 
but rather by following a logical pathway that illustrates the 
most relevant findings through the more relevant steps. 

A. Decaying lambda? 

Assumption A.3 about the A parameter (see section [TT- A3 1 ) 
does not translate immediately into numerical constraints and 
is therefore difficult to enforce in practical experiments. Partly 
for this reason, it is suggested in j2j to make A decay 
exponentially as the algorithm progresses, with the same law 
adopted for 5 : 

/ \ \ t / T 

A()• (11) 

2 This point cloud, together with other popular examples, can be downloaded 
at http://graphics.stanford.edu/data/3Dscanrep/ 










(C) (d) 

Fig. 2. An experiment with an NG with decaying A values (A i = 8.0, 
A f = 0.05, T = 4M) presented with a 2D uniform sample from the unit 
circle convolved with normal noise (a). After 150K iterations, the NG (b) is 
very close to the unit circle then, after 500K iterations (c), as A decreases, 
the NG begins dispersing until it reaches its final configuration (d), after 4M 
iterations. 


Note however that this decay law is not part of the model de¬ 
scribed by 0. In passing, the same decay law is also suggested 
in Kohonen’s Self-Organizing Map (SOM) algorithm since ‘it 
produces an improvement in the global order of units’ JT9). 

Fig. [2] shows the typical behavior of an NG with a decaying 

A. In this experiment the 2D-embedded input probability is 

^(S 1 )* .Af(0,E) 

where S 1 is the unit circle and the J\f is 2D isotropic multivari¬ 
ate normal, with a := 0.18 (see ([9])). Initially, when the value 
of A is large, the NG assumes a configuration that is closer to 
S 1 ; then, as the algorithm progresses and A decreases, the NG 
attains a more dispersed configuration that resembles closely 
the input distribution. As it can be seen, during the process, 
the NG undergoes substantial changes of ‘shape’ which are 
not necessarily reflected in the final configuration. 

Given the objectives of this work, these intermediate NG 
configurations are indeed relevant and therfore we focused on 
experiments with constant A values. 

B. Shape is relevant 

The changes in NG configurations and the relevance of 
geometrical features in the input probability P are shown 
by the experiments in Fig. [3j which describes four final NG 
configurations, each corresponding to different values of A, for 
the same 3D-embedded input probability 

U{B( 0,1)) (12) 

where U is the uniform distribution and 0,1) is the 3D unit 
ball centered in the origin. 

As it can be seen, depending on A, the final NG config¬ 
urations can be grouped into three main classes, or ‘phases’, 



(C) (d) 


Fig. 3. Four final NG configurations for the same uniform probability over 
a 3D unit ball (shown by the external ‘trackball’), with k = 512 and different 
(constant) A values. For A = 0 (a) the NG distributes uniformly as well. With 
greater values of A, an outer sphere (in orange) separates from an inner ball 
(in dark green), as shown for A = 4 (b) and A = 16 (c). For A > 32 (d) the 
NG disposes itself on the surface of an empty sphere. 


defined in terms of the distinct describ ing topologies (ball; 
sphere with an inside ball; empty sphere 

In addition, further experiments show that these transitions 
also depend on k and occur with remarkable regularity; in all 
experiments performed with the input probability above, with 
integer A values ranging from 0 to 32 and k equal, respectively, 
to 32, 64,128, 256, 512,1024 and 2048, the transition between 
the topology in Fig. [3jc) and that in Fig. |3jd) always occurs 
at A =£. 

This 3D phenomenon is much less evident in 2D, as 
described by Fig. [4] In the experiments performed, in the final 
NG configurations with a 2D-embedded probability of U( ID), 
where ED is the unit disk, the changes of the describing topology 
are much less dramatic than in the 3D case. 

C. Magnification 

Further experiments have been performed with the noise 
model alone, i.e. without a shape , using 2D and 3D multi¬ 
variate normal probabilities AE(0, £) with isotropic covariance 
matrix. The diagrams in Fig. [5] compare on a log-log plot the 
densities p( Wi) attained in final NG configurations and the 
probabilities P( w\) above, both estimated with ([ 7 ]) and the 
suggested optimal value of mo. 

Different data series represented in the diagrams corre¬ 
spond to A values ranging from 0 to 18 (data series with higher 
A values are shown in warmer colors). All of these have been 

3 The notion of topology-based ‘phase’ transitions for NG is left intuitive 
here for ease of discussion. A more precise definition, however, can be given 
along the lines described in |20] . 
















(C) (d) 

Fig. 4. A 2D uniform probability over a unit disk (shown by the outer 
circle) does not induce an NG a behavior similar to that in Fig. [3] i.e with a 
uniformly-sampled 3D ball as input. The final NG configurations represented 
here are for k = 128 and A equal to 0, 4, 8 and 16 respectively. 


obtained with k = 2048. As shown in the log-log plots, as A 
grows larger the power law becomes evident. More precisely, 
for A > 5 there exists a limit upper density to which the 
densest 5% NG units tend asymptotically, while the remaining 
95% NG units follow the power law. In addition, the estimated 
values of a is in substantial agreement with the value predicted 
by <(5l»; e.g. for A = 5 the estimated a values for d = 2 and 
d = 3 are 0.5132 and 0.5995 respectively, versus predicted 
values of 0.5 and 0.6. 

In passing, Fig. [6] shows the log-log plots obtained in the 
same conditions as for the experiemnts in Fig. [5] but with A 
values that decay following © from initial A^ in the range 
1-18 to A f = 0.001 in 5M iterations. Although the log-log 
plots in Fig. [6] are not very different from those in Fig. [5] it 
can be seen by comparing the two figures that when A is kept 
constant the region occupied by NG densities tends to shrink 
as A grows larger. 


D. Interplay between shape and magnification 

The interplay between the effects produced by shape in data 
distributions and the power law is effectively exemplified 
by the behavior shown in Fig. [ 7 ] The 3D data distribution used 
in this case is sampled from the convolution between a uniform 
probability over the unit sphere § 2 and a multivariate normal 
probability with a = 0.25 (see ®). Here, the overall NG 
behavior can be better discussed with the help of the following 
qualitative diagram that represents an idealization of the log- 
log density plots shown in Fig. [8j 



I nput Probability Density 


(b) 

Fig. 5. Log-log density plots of final NG configurations with, respectively, 
2D (a) and 3D (b) multivariate, isotropic normal probabilities, with constant 
A values ranging from 0 to 18 (shown with increasingly warm colors). 



When A is low, NG units tend to disperse like in Fig. |7Jb) 
and, away from the surface of the sphere, their densities 
tend to obey the power law whereas, close to the surface, 
these densities tend to reach a limit value. Overall, on the 
log-log plot, NG densities occupy a region that goes from 
‘magnification’ to ‘hotspot’ in the qualitative diagram, having 
an extent that also depends on k\ this region tends to shrink 
towards the ‘hotspot’ as A increases, as shown in Fig. [8ja). 
Interestingly, due to the curvature of the surface, NG densities 
close to the internal (i.e. ‘concave’) side of the sphere are 
slightly higher than the densities on the external (i.e. ‘convex’) 
side; this effect generates the ‘needle’s eye’ that can be 
observed in Fig. [8jb). When A is sufficiently large, the region 
occupied by NG densities shrinks to a point-like area (i.e. in 
the ‘hostspot’), as shown in Fig.[8jc), and all NG units dispose 
in close proximity to the surface of the sphere, as in Fig.[7Jd). 
Further increases in the value of A cause the NG to assume 
the configuration of a sphere with shrinking radius - while 
maintaining constant density, as shown in Fig. [8jd). 

Fig. [9ja) shows that, with k = 1024, the Shannon entropy 




















































(b) 

Fig. 6. Log-log density plots for the same experimental settings as in Fig. [5] 
but with decaying A values (see text). 


Fig. 7. A uniform sample (a) from a 3D unit sphere (i.e. shown by the 
‘trackball’) convolved with Gaussian noise. Presented with this input, an NG 
with k = 1024 remains somewhat dispersed for A = 0 (b) and A = 6 (c) 
while, for A > 10 (d), the NG disposes itself on the surface of a sphere. 


becomes maximal for the same value A = 10 for which 
the NG disposes on the sphere, and remains maximal for 
larger A values. In this case, in fact, the combined effect of 
spherical shape and constant NG densities makes the Voronoi 
cells corresponding to NG units to have (almost) the same 
volume and contain the same probability mass. From another 
standpoint, Fig. |9jb) describes the NG behavior in terms of 
geometrical proximity to the sphere, as measured by 

fo(W,§ 2 ) := max < min llw^ — xll 1 . (13) 

WjGW (xE § 2 J 

As it can be seen, the NG configuration is proximal to the 
sphere for A = 10 and then gradually distances itself as A 
increases, due to the shrinking effect. The NG behavior in 
point is also remarkably regular: with k values of 128, 256, 
512 and 1024 the minimum of the proximity function occurs 
when A is approximately equal to 

E. More complex shapes 

Fig. [I] shows the final NG configuration for an input data 
distribution obtained by convolving the Stanford bunny point 
cloud with isotropic gaussian noise with a = 0.05/, where / is 
the side length of the smallest cube containing all the points in 
the cloud. In the experiment shown, k = 4096 and A = 7. The 
log-log density plots in Fig.[lTJa) show that, as A increases, the 
NG densities tend to concentrate in a more restricted area. On 
the other hand, the log-log plots do not show a clear behavior 
as in the case of the sphere, possibly due to the much richer 
geometrical features of the bunny, both in terms of curvature 


and distance between different parts of the surfac^] Due to 
the same reason, the Shannon entropy diagram in Fig. |T2|a) 
shows a few heights in the range 3-7 and then decreases slowly 
but steadily; this suggests that with more complex shapes, with 
different local geometries, there will be no unique and optimal 
choice for the values of A and k. 

Nevertheless, the triangulated shape in Fig. |TJd) shows the 
existence, in this case, of a suitable range of A and k values 
that makes it possible a faithful reconstruction of the original 
surface from the final NG configuratiorj^] A critical parameter 
for this is the Hausdorff distance, defined as 

i &bunny) •— max |/l(W, S}j Unn y)i h^Sfrunny) W))- , 

where Sbunny is the surface of the bunny and h is the proximity 
function in ( [13] ). A sufficiently low d#, in fact, guarantees the 
possibility of reconstructing from W a triangulation that is 
both homeomorphic and geometrically close to the original 
2D surface. The diagram in Fig. [Tljb) shows that, for the case 
in point, the minimal dn value is attained for A = 7, making 
this NG configuration the most likely candidate. 

In general, the suitable range of both A and k values for 
surface reconstruction will be limited. With the Stanford bunny, 
for instance, it is not possible to reconstruct the surface for 
k < 1024, as the density of NG units becomes too low in 
critical areas, like e.g. on the ears of the bunny. Likewise, as 

4 More precisely, the local feature size W varies greatly over the bunny 

surface, while it is constant on the sphere. 

5 The surface in Fig. 0d) has been reconstructed with the ball pivoting 
method implemented in Meshlab |18| . 
















































Fig. 8. Piecewise justification of the qualitative diagram (see text) describing 
the NG behavior with the ‘noisy sphere’ in Fig. [7] With k = 4096, the log- 
log density plot (a) for A values in the range 0-18 shows that the power law 
is dominant for all units sufficiently away from the sphere while the effects 
of shape are more pronounced in its proximity; in particular, the detail for 
A = 6 (b) shows the ‘eye of the needle’. With k = 1024 and A > 10 (c) 
the NG disposes on a sphere, with uniform density (i.e. the red ‘dot’). With 
k = 128 and A > 2 (d) the NG disposes itself with uniform density on a 
sphere (blue ‘spot’ on the left) that shrinks progressively, as A increases (in 
warmer colors). 
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Fig. 9. Variations in Shannon entropy (a) and proximity function (b) w.r.t. A 
for final NG configurations in Fig. [7] For A = 10 the value of entropy attains 
the theoretical maximum H = 6.9314 (dashed line in red) and remains at the 
same level even with larger A values. The proximity function (b) h( W,§ 2 ) 
reaches a minimum for A in the range 10-13 and then gradually increases as 
the NG configurations begin to shrink. 


shown in Fig. [TO] for A < 6 the final NG configuration is too 
dispersed and for larger A values the shrinking tendency of the 
NG entails the loss of important topological details. 

On the other hand, this particular NG behavior is quite 
robust with respect to different (isotropic) noise models. In 
the experiments performed, the Stanford bunny has been 
convolved with the sinsuoidal probability in ( fTO] ) with r = 2a, 
where a = 0.05/ is the same value as above. With k = 4096 
and A = 7 the reconstruction is again successful. Further 
experiments have also been performed by convolving the same 
point cloud with the uniform probability U(B(0,r)) with 
r = cr; for k = 4096 and A = 6 the reconstruction is successful 
as well. 


IV. Discussion 

The experimental evidence presented confirms the validity 
of the magnification model for the Neural Gas, even 
with relatively large values of A, whenever the shape of the 
input probability P is not particularly relevant. Vice versa, 


Fig. 10. Final NG configurations for the noisy sample of the Stanford 
bunny (see Fig.QJb)); with A = 0 (a) the configuration is too disperse for the 
purposes of surface reconstruction while with the optimal value A = 7 (b) this 
is possible (see Fig. |TJd)). With A = 18 (c), however, the NG configuration 
alters significant shape features: as it can be seen in the detail (d), the ears 
are no longer hollow and the NG disposes on a surface. 



Fig. 11. With the noisy Stanford bunny and k = 4096, the log-log density 
plots (a) for final NG configurations with different values of A in the range 
0-18 reflect multiple effects at once: it can be seen however that NG densities 
tend to be confined in a smaller area as A increases; in particular, the detail 
(b) shows the densities for the optimal value A = 7. 


when the geometrical and topological features of P are more 
pronounced, the NG behaves in ways that are not explained 
by the magnification law alone. As already stated, this further 
evidence is not in contrast with the original NG model in [2] 
as its analytical derivation relies in fact on neutralizing the 
effects of shape. 

The experiments performed show that the effects of shape 
in P, when present, become dominant in determining the final 
NG configurations. Although at present these phenomena can 
be assessed only empirically, the NG response to geometric 

























































Fig. 12. Variations in Shannon entropy (a) and Hausdorff distance (b) w.r.t. 
A for the NG experiments with the noisy sample of the Stanford bunny in 
Fig.QJa). The entropy reaches its top value, close to the theoretical maximum 
(dashed line in red), for A = 7 and then decreases with larger A values. 
The Hausdorff distance (b) reaches a minimum for the same value and then 
increases gradually. 

features seems to be describable in precise terms, at least with 
specific and controlled benchmark shapes. 

For practical purposes, the experiments also show that 
the NG behavior described has the interesting potential for 
performing a specific sort of online blind deconvolution (22); 
online as the NG adapts its configuration via SGD in response 
to a stream of incoming pointwise signals, and blind since the 
noise model needs not be known beforehand. 

Further work is clearly necessary to assess the usefulness 
of the NG behavior with more realistic and complex examples, 
for instance with the non-uniform sampling of shapes and/or 
with anisotropic noise models. In addition, another direction 
for further studies is about the impact on the NG response 
to shape with the various techniques for magnification control 
described in the literature 0-0, (15), i-e. having the 
objective of controlling the a factor in the power law ([5]). 
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